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ABSTRACT 

The third of three sequels to the booklet ''Student 
Assessment," this booklet begins by describing and giving examples of 
three forms that essay-type questions can take: (1) 

unstructured-essay questions; (2) structured-essay questions; and (3) 
short^'notes questions. Guidelines are then provided for deciding 
«/hich type of question to use in a given situation and basic rules 
for writing essay-type questions are presented. Practical advice on 
how to evaluate and mark essay-type questions concludes the booklet. 
An annotated list of three items recommended for further reading is 
included. (MES) 
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Essay-type Questions 



Introduction 

This booklet forms a sequel to the booklet on 'Student assessment*, 
which presents a broad survey of the field and examines the different 
assessment techniques that can be employed therein. The present 
booklet deals in more detail with one particular group of assessment 
instruments, namely, extended questions of the essay type. 

The booklet begins by examining the different forms that essay-type 
questions can take and offering guidance on how to decide which 
type to use in a given situation. Next, it gives detailed guidance on 
how to write essay questions of different types. Finally, it offers 
practical advice on how to evaluate and mark essay-type questions. 



The different forms of essay-type questions 

As was indicated in the booklet on 'Student assessment*, 'extended- 
writing* questions of the essay type are still one of the most widely 
used forms of assessment question despite their numerous weak- 
nesses and limitations (doubtful validity, low reliability, etc.). Let us 
therefore begin by taking a look ct the various forms that such ques- 
tions can take. 

Unstructured*essay questions 

These are essay questions which are worded in such a way as to give 
the writer the maximum possible freedom to determine the nature 
and scope of his response - subject, of course, to the intrinsic 
constraints imposed by the subject matter, the available time, etc. 
They are also known as extended-response questions or free-re- 
sponse questions. Three typical examples are given below. 

Example 1 

'Write an essay of roughly 3 pages on the character of Hamlet*. 
Example 2 

'Do practising scientists really employ a "scientific method", or is 
the term simply a figment of the imagination of philosophers? 
Discuss in roughly 1200-1500 words.* 

Example 3 

'Select any social or ethical issue involving science or technology, 
state your personal position regarding this issue, and present a 
reasoned argument of roughly 1000 words justifying same*. 



Structured-«stay questions 

These questions (which are also known as restricted-response 
questions) differ from unstructured-essay questions in that they give 
the testee far less freedom to determine the nature and scope of the 
response. Indeed, they are deliberately worded in such a way as to 
give the testee a considerable amount of guidance as to what the 
structure and content of the essay should be. Three typical examples 
are again given below. 

Example 1 (a straightforward stri ^tured-essay question) 
•Write an essay of betyyeen three and five pages on the biological 
effects of ionising radiation, dealing first with the general effects of 
radiation on living tissue, then with the specific effects on human 
beings (at bolh -whole body" and -individual organ" level), and 
finally with the possible long-term genetic effects on the human 
race' . 

Example 2 (a structured-essay question involving presentation of 
standard theory) 

•Explain why a very heavy nucleus can move to a more stable 
configuration by undergoing nuclear fission and use the semi-empiri- 
cal mass formula to derive an expression for the amount of energy 
that is released by the symmetric fission of such a nucleus. (5) 
Explai'^ why the value of the energy release that is obtained using this 
expression is always smaller than might be expected. (2) 
With the aid of a clearly-labelled diagram, explain how the potential 
barrier that opposes spontaneous nuclear fission arises. Discuss the 
factors that determine whether or not a given nucleus is basically 
stable against spontaneous fission. Explain what is meant by the 
-fissionability parameter" of a nucleus, and derive the criterion for 
stability. (1^) 
Briefly explain why a nucleus that is basically stable against 
spontaneous fission can have a finite probability of undergoing such 
fission.' (2) 

Example 3 (a structured-essay question of the 'problem' type) 
*A space vehicle is moving round the Earth in a circular orbit of ra- 
dius 15,000 km and is to be transferred to a coplanar circular orbit of 
radius 30,000 km. With the aid of a clearly-labelled diagram, de- 
scribe the process by which this transfer can be brought about with 
the minimum expenditure of fuel. (6) 
Assuming that the mass of the vehicle does not change significantly 
during the motor burns needed to bring about the above manoeuvre, 
find the values of the velocity changes needed to execute the 



manoeuvre, explaining the origins of any formulae that you 
use. 



Constant of universal gravitation = 6.67 x 10"^ Nm kg*"^ 
Mass of Earth = 5.98 x 10^^ kg ' 

Short^notes questions 

These are questions where the answer is shorter than for a full essay 
question but longer than for an 'open' short-answer question. Such 
questions can take a wide range of forms, and can be incorporated 
in tests and examinations of all types. Two typical examples are given 
below. 

Example 1 (a short-notes question of the type that might be 
incorporated in a conventional 'answer any x from y'-type essay 
paper as one of the options) . 

'Select FOUR of the following topics, and, in each case, explain v;hat 
the effect or phenomenon is and give a physical explanation of how it 
arises. 

(a) Thomson effect (d) ferroelectricity 

(b) Peltier effect (e) piezoelectric effect 

(c) Meissner effect (f) magnetostriction (5 marks each) 

Example 2 (a short-notes question of the type that might be 
incorporated in a paper consisting of a series of such questions, or 
of a mixture of short-answer and short-notes questions.) 

'With the aid of a clearly-labelled diagram, describe the electronic 
band structure of diamond and explain why it is an electrical 
insulator.' (4 ^arks) 

Deciding which type of question to use 
In a given situation 

As was suggested in the booklet on 'Student assessment', essay 
questions are best suited for testing a student's powers of synthesis 
and evaluation - the top two levels of the cognitive domain, although 
they are also frequently used to assess learning outcomes and skills 
that lie lower down the cognitive domain. As we have seen, these 
lower-level cognitive areas (/rnow/ec/ge. comprehension, application 
and analysis) are far more suited to assessment using questions of 
the multiple-choice or short-answer type. Essay questions are, of 
J- irse, also highly suitable for testing a student's written 



communication skills, and are often used as a vehicle for doing just 
this. 

Thus, anyone who is thinking of using essay-type questions as the 
basis uf a student assessment scheme should first ask himself 
whether this type of question is really the most suitable for what he 
has in mind. In other words, he should ask whether the main learning 
outcomes that he is trying to assess lie in the higher cognitive areas 
of synthesis arKJ evaluation or are specifically concerned with written 
communication skills. If they do not, then he should seriously think of 
employing some other, more suitable, form of assessment vehicle 
(see the booklet on 'Student assessment' for a review of the various 
techniques that are available) . 

Having said this, however, it is appreciated that a person setting a 
test or examination is often expected to write this in the form of a 
traditional 'answer any x from y' essay test, regardless of whether 
the extended essay question is in fact the most suitable vehicle for 
the assessment in question. If this is so, the designer of the test or 
examination should at least try to match the styles of the questions to 
the specific learning outcomes and skills that it Is wished to test, in 
so far as this is possible. Thus, if the outcomes being tested lie 
mainly in the lower-to-middle region of the cognitive domain (i.e. 
are mainly related to knowledge, comprehension, application or 
analysis) , he should restrict himself to structured-essay questions or 
short-notes questions, which, although not ideally suited for testing in 
these areas, can be used lo do so fairly effectively if properly 
designed. Unstructured-essay questions, on the other hand, should 
only be used if the outcomes being tested fall in the areas listed in 
the last paragraph, i.e. are mainly concerned with synthesis or 
evaluation, or with written communication sidlls. Indeed, the most 
suitable role for sue!; <^ssay questions is probably in course work or 
continuous assessment rather than in formal examinations, since it is 
generally only in such contexts that students really have time to do 
full justice to this most demanding of assessment vehicles. 



How to write essay-type questions 

The construction of clear, unambiguous essay questions that 
effectively assess what they are Intended to assess is a much more 
difficult task than is commonly supposed. As with other types of 
questions, however, the observance of a number of basic rules can 
help to make the task somewhat easier. Some of the more important 
of these are given below. 

1 . Match the question to the specific outcomes being assessed 

7 



As we saw in the previous section, it is important to choose the 
correct style of essay question in any particular situation. It is 
also important to design the question in such a way that it as- 
sesses those particular learning outcomes or skills in which 
you are interested. Thus, as in the case of multiple-choice or 
short-answer questions, the best way to start is with a precise 
specification of the behaviour that is to be measured. This will 
help you to determine both the content and the form of the 
question, and should also be of considerable assistance in de- 
ciding how to express it. 

Formulate the question so i at the student is presented with a 
clearly-defined task (or series of tasks) and knows exactly what 
is expected of him/her. 

This is again absolutely fundamental - not only for highly ex- 
plicit structured-essay and short-notes questions but also for 
questions of the free-response type. In the case of the for- 
mer, it is generally possible to define the task completely in 
the wording of the actual question (see, for example, the vari- 
ous examples given on pages 2 and 3.) With unstructured es- 
say questions, on the other hand, this is much more difficult to 
do without defeating the whole object of the exercise by tying 
the writer down to a rigid pattern and limiting his freedom to 
select, organise and present the material that he or she feels 
to be appropriate. One way round this problem is to indicate to 
the students the criteria that are to be used in marking the 
essay, e.g. by including a statement of the following type. 

The following factors will be taken into account when marking 
this essay (or the various questions in this paper): 

the extent to which the topic is fully covered; 
the relevance and appropriateness of the material that is 
included; 

the extent to which arguments are well presented and 
supported; 

the skill with which the material is organised and struc- 
tured.' 



In the case of unstructured essays that are set as part of 
course work or continuous assessment, it may sometimes be 
appropriate to be even more specific with regard to what is 
being looked for - particularly if the essay is being used as a 
vehicle for helping the students to develop written communica- 
tion skills. Indeed, it may well be appropriate in such cases to 
tell the students that a certain proportion of the marks will be 
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awarded on the basis of the 'craft skills' that they 
demonstrate, and to provide a detailed explanation of what 
exactly is being looked for in respect of same. An example of a 
set of guidelines of this type is given below. 

'The craft skills being looked for In the essays' 

In order to gain a high 'craft skills' mark, an essay should have 

the following characteristics. 

(a) It should have a logical and clearly-defined structure, as 
evidenced by division into sections and use of section 
headings. 

(b) It should be sound in respect of grammar, punctuation, 
spelling and style. 

(c) It should include an Introduction that clearly states: 

(i) how you have chosen to interpret the question 
under discussion; 

(ii) how you intend to tackle the question in the essay. 

(d) The main body of the essay should consist of clear, 
thorough and (wherever possible) substantiated argu- 
ments; references should be indicated in the text by giv- 
ing the author and cfafe - e.g. (Jones, 1983); 

(e) It should include a Conclusion that summarises and/or 
draws together the main points. 

(f) It should include a References section that lists the 
sources of materiel cited in the text. Each reference 
should contain the following information: 

(I) Books; author; date; title; publisher; page no(s). 

(il) Articles, papers, etc; author, date; title; name of 
Journal or book in v.hich it appears (including vol- 
ume and issue numbers in the case of a journal, or 
name of editor or compiler and publisher in the 
case of a book); page no(s). 

(g) It should include a Bibliography section that shows evi- 
dence of background reading in connection with the es- 
say. This should take the same form as the Reference 
section, except that page numbers need not be in- 
cluded.' 

The stuoents should, of course, also be given some indication 
of the length of the essay that they are expected to produce. 

Express the question in clear, simple, unambiguous language 
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This Is just as important in the case of essay-type questions as 
it is with multiple-choice and short-answer questions. Thus, 
words should be chosen with extreme care, and the question 
phrased in such a way that the student does not have to waste 
time trying to work out exactly what it means. Remember that 
a good assessment item should test the student's knowledge 
of the material on which the question is set, not his ability to 
interpret the question. Also, try not to set questions that can 
be answered with a single word or short phrase, e.g.: 'Do you 
think that uncontrolled wage bargaining is the most important 
cause of inflation?' (possible answers: 'yes' or 'no') 
or 

'What do you know about Einstein's General Theory of 
Relativity?' (possible answer: ' alH'). 

4. Provide appropriate supplementary Inforrr^ation 

If a question involves the use of data, physical constants, for- 
mulae etc. which the student is not expected to know from 
memory, make sure that everything needed is provided - 
either as part of the question or at the start of the paper. 
If a question involves calculations, tell the student what degree 
of accuracy is expected, whether working has to be shown, 
whether any assumed formulae or equations have to be stated 
or explained, etc. 

5. Provide a mark breakdown where this Is appropriate 

In the case of structured questions, the student often has no 
idea of just how much he is expected to write on each 
component of the question. Such confusion can generally be 
minimised by providing a detailed mark breakdown alongside 
the different parts of the question (as in the question on 
nuclear fission on page 2). Such a breakdown is, of course, 
seldom possible (or appropriate) in the case of unstructured 
essay questions, except in cases where marks are awarded on 
the basis of different criteria (e.g. x% for content; y% for craft 
skills). 



How to evaluate essay-type questions 

As in the case of objective and short-answer questions, it is always a 
good idea to have essay questions evaluated in some way before 
they are set to students. Since essay questions do not lend 
themselves to the sort of objective, quantitative evaluation that can 
be applied to the former, however, the only effective way in which 



this can be done in practice is to have the questions carefully vetted 
by a colleague or validation panel. 

An essay question should be prepared for such evaluation in much 
the same way as a multiple-choice or short-answer question, 
preferably by presenting it on a standard pro-forma of some sort. 
This should not only show the full text of the question, together with 
any ancillary instructions, data, or material, but should also state: 

• the course, module, syllabus, etc. that the question relates to; 

• the purpose for which the question is to be used; 

• the particular topic (or group of topics) that the question re 
lates to; 

• the particular educational skills or outcomes that the item is 
designed to assess. 

It should also state the name of the originator of the item and the 
date of production. 

It is also important to provide the person or group that is to carry out 
the evaluation with a clear idea of the sort of answer that is expected. 
In the case of a structured-essay or short-notes question, this can 
either be done by providing a list of the key points that the answer 
should cover, together with the marks to be awarded for each, or by 
preparing a complete model answer, again with an associated mark 
breakdown scheme. In the case of an unstructured essay, on the 
other hand, preparation of either of these forms of marking guide is 
seldom possible, so the best way to proceed is probably to draw up a 
list of the criteria with respect to which the essay is to be marked - 
preferably with a guide to the weighting that is to be associated with 
each. 

Ideally, the colleagues or validation panel carrying out thb evaluation 
should also be provided with an appropriate pro-forma on which to 
note their conclusions. This should ask for the following information 
about the question: 

• Is the question relevant to the course/module/syllabus to 
which it relates? 

• Is the question style appropriate to the topic being covered 
and the specific educational skills or outcomes being as- 
sessed? 

• Does the question provide the testees with a clearly-defined 
task? 

• Is the question logically and structurally sound? 

• Is the question stated in clear, simple language? 



• Is the question of a suitable level of difficulty? lengiM? 

• Is the proposed marking scheme appropriate? fair? 

Obviously, any weaknesses or deficiencies identified by the evalu- 
ation process should be remedied before the question is put to use - 
after being subjected to further evaluation, if necessary. 

If it is a complete examination or test paper that is being evaluated, a 
number of further questions should be asked: 

• Does the paper provide adequate coverage of the syllabus/ 
module/course in respect of which it has been set? 

• If the paper allows the students a choice of queslions. 

(a) are the questions of comparable difficulty and length? 

(b) have steps been taken to ensure that every student an- 
swers questions on a suitably wide range of topics or 
areas? 



How to mark essay-type questions 

As was indicated in the booklet on 'Student assessment*, one of the 
major limitations of essay tests is the inevitable high degree of 
subjectivity associated with the marking - something that can greatly 
reduce their reliability. Even with the best will in the world, for 
example, the marker may find it difficult to exclude from his 
judgement such things as: 

• his personal feelings towards the wnter of the essay 
(favourable or unfavourable) ; 

• his own personal opinions (or prejudices I) regarding the topics 
being discussed or the arguments or views being presented; 

• extraneous factors not related to the intrinsic worth of the con- 
tent (untidy presentation, writing that is difficult to read, poor 
spelling, bad grammar etc.) 

Thus, when marking essay questions, a supreme effort should be 
made to do so in as objective a manner a. possible. Observing the 
following general guidelines sh-^uld help to make this easier. 

1 . Always mark essay questions in terms of the specific learning 
outcomes being measured 

As we saw earlier, essay questions should always be set with 
specific educational skills or outcomes in mind. Thus, when 
marking such questions, these outcomes should be used as 
the sole (or main) criteria on which the marking is based. If a 
J question is designed simply to measure the student's ability to 



ERIC 



6::p:3ln a particular cause-effect relationship, for example, the 
answer should be evaluated in terms of just how adequately it 
does just that. All other factors, such as interesting but irrele- 
vant factual information, style, spelling, grammar, legibility and 
neatness should (in so far as this is possible or appropriate) be 
ignored during the evaluation. It may well be, of course, that a 
certain proportion of the marks are awarded for some of these 
other factors, but they should still not be allowed to influence 
the mark that is awarded in respect of the central criterion. 

2. Always mark structured-essay or short-notes questions by 
some T.ort of 'point method' 

As we saw in the previous section, a list of the key points to be 
covered, or a model answer, should generally be produced in 
association with a question of the structured-essay or short- 
notes type - as a guide for the person carrying out the evalu- 
ation of the question. Needless to say, such a list or mode! 
answer should also be used as a guide during the mari<ing of 
the question, with marks being awarded strictly In accordance 
with the scheme that is incorporated therein. By adopting such 
a procedure, it is generally possible to mark structured-essay 
or short-notes questions with a fairly high degree of objectivity 
- and hence a high degree of reliability - provided, of course, 
that proper care has been taken in the design of both the 
question and the marking scheme. 

3. Always employ clearly-defined criteria when marking unstruc- 
tured essay questions 

As we saw eariier, unstructured essay questions are intrinsi- 
cally unsuited to a 'point method' of marking of the type that 
can be used with highly structured or prescriptive questions. 
Thus, the only way in which such questions can be marked 
with any degree of objectivity is to base the marking on a suit- 
able set of criteria of which the students writing the essays 
have been made fully aware. Even when this is done, a consid- 
erable degree of subjectivity will almost certainly remain, but, 
by choosing the criteria with caie and then rigidly adhering to 
them during the marking process, this can be kept to a mini- 
mum. 

Because of the difficulty associated with assigning meaningful 
numerical marks to unstructured essays, a less discriminating 
marking scheme based on the use of grades rather than marks 
is often employed. One of the most widely used systems of 
this type is the A, B, C, D, E scale, which typically awards an 
•A' for an essay of First Class Honours standard, *B' for an 
ess^y of "Upper Second" standard. *C' for "Lower Second", 
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and so on. When marking to such a scale, it is often a good 
idea to read the essays more than once, using the first reading 
to arrange them in rough rank order and the second reading to 
refine the ranking and assign the final grades. An alternative 
method is to award a separate n^urk or grade in respect of 
each of the criteria being used to evaluate the essay and then 
base the final overall grade on these. 

Always mark essay tests 'question by question' 
rather than 'student by student' 

Scoring or grading essay tests by marking all the responses to 
a given question before proceeding to the next helps to make 
it possible to maintain a uniform standard in carrying out this 
nnarking. This procedure also helps to reduce the halo effect in 
marking (the process whereby the mark awarded to a particu- 
lar student in respect of a given question is influenced by the 
general impression of that student gained from marking other 
questions). The halo effect can be further reduced by marking 
the questions 'annonymously' in so far as this is possible, e.g. 
by making a conscious effort not to notice the name on the 
front of the response book when marking a particular question. 
This, of course, can be difficult, or even impossible - particu- 
larly in cases where the marker is thoroughly familiar with the 
handwriting, styles, etc. of the individual students. 

If possible, have essay questions marked 
by more than one person 

By far the best way to check on the reliability of the marking of 
essay questions (particularly unstructured essays) is to obtain 
two or more independent judgements. While this may simply 
not be feasible for all routine classroom testing, it should be 
done from time to time just as a check. Obtaining two or more 
independent ratings is, of course, particularly vital in situations 
where the results are to be used for making important or irre- 
versible decisions, such as the selection of students for further 
•raining or study (e.g. admission to the honours year of a 
course) or for the award of honours, gradings or prizes. Here, 
the pooled ratings of several competent persons may be 
needed to attain a level of reliability that is commensurate with 
the significance of the decision being made. 
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Further Reading 



1. Constructing Achievement Tests, by N E Gronlund; Prentice 
Hall Inc., Englewood Cliffs, New Jersey; 1968 (An extremely 
useful source of guidance on all forms of assessment, includ- 
ing essay questions.) 

2. Fundamentals of Measurement, by N M Downie; Oxford Uni- 
versity Press; 1967 (Another useful book that deals with essay 
tests in some detail.) 

3. Test Construction, by D A Wood; Columbus, Ohio; 1960 (A 
third general book on assessment that contains useful material 
on the design of essay questions and essay tests.) 
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